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BACKGROUND OF THE INVENTION 



1. Field of the Invention 

This invention relates to computer system input/output (I/O), and more 
particularly, to observing transactions occurring on a bus for debug purposes. 

2. Description of the Related Art 

In a typical computer system, one or more processors may communicate with 
input/output (I/O) devices over one or more buses. The I/O devices may be coupled to 
the processors through an VO bridge which manages the transfer of information between 
a peripheral bus connected to the I/O devices and a shared bus connected to the 
processors. Additionally, the VO bridge may manage the transfer of information between 
a system memory and the I/O devices or the system memory and the processors. 

Unfortunately, many bus systems suffer from several drawbacks. For example, 
multiple devices attached to a bus may present a relatively large electrical capacitance to 
devices driving signals on the bus. In addition, the multiple attach points on a shared bus 
produce signal reflections at high signal frequencies which reduce signal integrity. As a 
result, signal frequencies on the bus are generally kept relatively low in order to maintain 
signal integrity at an acceptable level. The relatively low signal frequencies reduce signal 
bandwidth, limiting the performance of devices attached to the bus. 

Lack of scalability to larger numbers of devices is another disadvantage of shared 
bus systems. The available bandwidth of a shared bus is substantially fixed (and may 
decrease if adding additional devices causes a reduction in signal frequencies upon the 
bus). Once the bandwidth requirements of the devices attached to the bus (either directly 
or indirectly) exceeds the available bandwidth of the bus, devices will frequently be 
stalled when attempting access to the bus, and overall performance of the computer 
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system including the shared bus will most likely be reduced. An example of a shared bus 
used by I/O devices is a peripheral component interconnect (PCI) bus. 

Many I/O bridging devices use a buffering mechanism to buffer a number of 
pending transactions from the PCI bus to a final destination bus. However buffering may 
introduce stalls on the PCI bus. Stalls may be caused when a series of transactions are 
buffered in a queue and awaiting transmission to a destination bus and a stall occurs on 
the destination bus, which stops forward progress. Then a transaction that will allow 
those waiting transactions to complete arrives at the queue and is stored behind the other 
transactions. To break the stall, the transactions in the queue must somehow be reordered 
to allow the newly arrived transaction to be transmitted ahead of the pending transactions. 
Thus, to prevent scenarios such as this, the PCI bus specification prescribes a set of 
reordering rules that govern the handling and ordering of PCI bus transactions. 

To overcome some of the drawbacks of a shared bus, some computers systems 
may use packet-based communications between devices or nodes. In such systems, nodes 
may communicate with each other by exchanging packets of information. In general, a 
"node" is a device which is capable of participating in transactions upon an interconnect. 
For example, the interconnect may be packet-based, and the node may be configured to 
receive and transmit packets. Generally speaking, a "packet" is a communication 
between two nodes: an initiating or "source" node which transmits the packet and a 
destination or "target" node which receives the packet. When a packet reaches the target 
node, the target node accepts the information conveyed by the packet and processes the 
information internally. A node located on a communication path between the source and 
target nodes may relay or forward the packet from the source node to the target node. 

Additionally, there are systems that use a combination of packet-based 
communications and bus-based communications. For example, a system may connect to 
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a PCI bus and a graphics bus such as AGP. The PCI bus may be connected to a packet 
bus interface that may then translate PCI bus transactions into packet transactions for 
transmission on a packet bus. Likewise the graphics bus may be connected to an AGP 
interface that may translate AGP transactions into packet transactions. Each interface 
may communicate with a host bridge associated with one of the processors or in some 
cases to another peripheral device. 

When PCI devices initiate the transactions, the packet-based transactions may be 
constrained by the same ordering rules as set forth in the PCI Local Bus specification. 
The same may be true for packet transactions destined for the PCI bus. These ordering 
rules are still observed in the packet-based transactions since transaction stalls that may 
occur at a packet bus interface may cause a deadlock at that packet bus interface. This 
deadlock may cause further stalls back into the packet bus fabric. In addition, AGP 
transactions may follow a set of transaction ordering rules to ensure proper delivery of 
data. 

Depending on the configuration of the I/O nodes, transactions may be forwarded 
through a node to another node either in a direction to the host bridge or away from the 
host bridge. Alternatively, transactions may be injected into packet traffic at a particular 
node. 

One of the disadvantages of some packet-based communications is the lack of 
ability to observe transactions that occur on the packet bus. Often times during the design 
phase of a computer system board, it is necessary to perform testing and debugging to 
ensure compatibility with various peripheral devices. Similarly, when designing a new 
peripheral device, it is often necessary to perform testing an debugging to ensure its 
compatibility with the host computer system(s) for which it is being designed. 
Furthermore, the inability to monitor transactions on some packet bus architectures may 
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hinder efforts of to isolate and repair a fault in an operational computer system employing 
the packet bus. Thus, if a fault occurs on the packet bus itself, or one of the I/O nodes 
coupled to the packet bus, it may not be possible to isolate. 

SUMMARY OF THE INVENTION 

A system and method for observing transactions on a packet bus is disclosed. In 
one embodiment, a computer system includes a plurality of input/output (I/O) nodes 
serially coupled to a processor. Each of the I/O nodes may be configured to operate in a 
first (normal) mode, and a second (analysis) mode. During the normal mode, packets 
may be selectively conveyed through an I/O tunnel in the I/O node, and particular packets 
may be selectively conveyed to a peripheral bus interface in the I/O node. In the analysis 
mode, electrical signals corresponding to packets conveyed through the I/O tunnel may be 
replicated on a peripheral bus coupled to the peripheral bus interface. No conversion 
from the packet bus protocol to the peripheral bus protocol is required in order for the 
electrical signals to be replicated onto the packet bus. A signal analyzer may be coupled 
to the peripheral bus, thereby allowing observation of the electrical signals. 

In one embodiment, a dummy card may be inserted into a connector on the 
peripheral bus. A signal analyzer or logic analyzer may then be coupled to the dummy 
card. Electrical signals corresponding to packets conveyed on the packet bus may then be 
observed using the signal/logic analyzer. In another embodiment, a signal/logic analyzer 
card (i.e. computer based instrumentation) may be inserted directly into the connector in 
order to allow the observation of electrical signals corresponding to conveyed packets. 

In various embodiments, the I/O node may include a command register configured 
to store one or more bits indicative of the mode in which the I/O node is currently 
operating. In one embodiment, the I/O node may be placed into the analysis mode by 
latching the state of one or more input signals into the register from the peripheral bus. 
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The one or more input signals may correspond to the one or more bits stored in the 
register for indicating the current mode of operation. The latching may be performed 
during a power-on reset of the I/O node, with the signals being driven to the command 
register via the peripheral bus. The analysis mode may be exited by performing another 
power-on reset without latching the appropriate signal states to the command register. 
Other embodiments are possible and contemplated wherein other means are used to enter 
and exit the analysis mode, and the signals for entering the analysis mode may be 
conveyed from buses other than the peripheral bus. Furthermore, embodiments are 
possible and contemplated wherein a power-on reset is not required to enter or exit the 
analysis mode. 

Some embodiments of the I/O node may also include an arbitration unit. The 
arbitration unit may determine the order in which electrical signals corresponding to a 
given packet appear on the peripheral bus relative to electrical signals corresponding to 
other packets which are also to appear on the peripheral bus. In some cases, two or more 
packets may pass through the I/O node simultaneously. In such situations, the arbitration 
unit may determine which of the packets will be replicated onto the peripheral bus first. 
This may allow for all packets conveyed through the I/O node to be observed even when 
the peripheral bus bandwidth is less than the bandwidth of the packet bus. 

In various embodiments, the peripheral bus may be a peripheral component 
interconnect (PCI) bus, a general-purpose instrument bus (GPIB), an advanced graphics 
port (AGP) bus, or any other type of peripheral bus. 

As previously noted, the transactions replicated from the packet bus need not 
match the protocol of the peripheral bus in order to observe them. In addition to 
replicating electrical signals from packets conveyed on the packet bus, the I/O node may 
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also provide an indication as to whether a particular packet is being conveyed upstream 
(towards a host processor) or downstream (away from a host processor). 

Because the system and method may utilize the I/O node and an existing 
peripheral bus connector, no additional hardware or alteration to the system board is 
needed in order for implementation. The ability to monitor packets conveyed on the 
packet bus may aid in debugging errors occurring between a host processor and a 
peripheral device. Fault isolation may be further aided by the ability to determine 
whether a particular packet is being conveyed upstream or downstream. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



Other aspects of the invention will become apparent upon reading the following 
detailed description and upon reference to the accompanying drawings in which: 

Figure 1 is a block diagram of one embodiment of a computer system; 

Figure 2 is a block diagram of one embodiment of an I/O node; 

Figure 3 is a block diagram of one embodiment of a computer system configured 
to allow the observation with a logic analyzer of packets conveyed on a packet bus; 

Figure 4 is a block diagram of another embodiment of a computer system 
configured to allow the observation with a logic analyzer of packets conveyed on a packet 
bus; 

Figure 5A is a block diagram of one embodiment of a computer system, the 
diagram illustrating the operations of an I/O node in a normal mode; and 

Figure 5B is a block diagram of the embodiment shown in Figure 5A, the diagram 
illustrating the operations of an I/O node in an analysis mode. 

While the invention is susceptible to various modifications and alternative forms, 
specific embodiments thereof are shown by way of example in the drawings and will 
herein be described in detail. It should be understood, however, that the drawings and 
detailed description thereto are not intended to limit the invention to the particular form 
disclosed, but on the contrary, the intention is to cover all modifications, equivalents and 
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alternatives falling within the spirit and scope of the present invention as defined by the 
appended claims. 

DETAILED DESCRIPTION OF THE INVENTION 

Turning now to Figure 1, a block diagram of one embodiment of a computer 
system is shown. The computer system includes processors 10A-10D each 
interconnected by a coherent packet bus including links 15A-D. Each link of coherent 
packet bus 15 may form a high-speed point-to-point link. The computer system also 
includes three I/O nodes numbered 20, 30 and 40 each connected together in a chain by 
non-coherent (NC) packet bus links SOB and 50C respectively. NC packet bus link 50A 
is coupled between host node/processor 10A and I/O node 20. Processor 10A is 
illustrated as a host node and may include a host bridge for communicating with I/O node 
20 via NC packet bus link 50A. Processors 10B-D may also include host bridges for 
communication with other I/O nodes (not shown). The NC packet bus links formed by 
NC packet bus 50A-C may also be referred to as a point-to-point links. I/O node 20 is 
connected to a pair of peripheral buses 25A-B. I/O node 30 is connected to a graphics 
bus 35, while I/O node 40 is connected to an additional peripheral bus 45. It is noted that 
in other embodiments, other numbers of processors may be used. 

In the present embodiment, each link of coherent packet bus 15 is implemented as 
sets of unidirectional lines (e.g. lines 15A are used to transmit packets from processor 
10A to processor 10B and lines 15B are used to transmit packets from processor 10B to 
processor 10C). Other sets of lines 15C-D are used to transmit packets between other 
processors as illustrated in Figure 1. The coherent packet bus 15 may be operated in a 
cache coherent fashion for communication between processing nodes ("the coherent 
link"). Further, non-coherent packet bus 50 may be operated in a non-coherent fashion 
for communication between I/O nodes and between I/O nodes and a host bridge such as 
the host bridge of processor 10A ("the non-coherent link"). The interconnection of two 
or more nodes via coherent links may be referred to as a "coherent fabric". Similarly, the 
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interconnection of two or more nodes via non-coherent links may be referred to as a "non- 
coherent fabric". It is noted that a packet to be transmitted from one processor to another 
may pass through one or more intermediate nodes. For example, a packet transmitted by 
processor 10A to processor IOC may pass through either processor 10B or processor 10D 
as shown in Figure 1. Any suitable routing algorithm may be used. 

Processors 10A-10D are each illustrative of, for example, an x86 microprocessor 
such as an Athlon™ microprocessor. In addition, one example of a packet bus such as 
non-coherent packet bus 50 may be compatible with HyperTransport™ technology. 
Peripheral buses 25 A, 25B and 45 are illustrative of a common peripheral bus such as a 
peripheral component interconnect (PCI, or PCIX, an extended version of PCI) bus and 
graphics bus 35 is illustrative of an accelerated graphics port (AGP) interconnect, for 
example. It is understood, however, that other types of processors may be used, as well 
as other types of buses, including a general-purpose instrument bus (GPIB), industry 
standard architecture/extended industry standard architecture (ISA/EISA) buses, and so 
forth. 

It is noted that while three I/O nodes are shown connected to host processor 10A, 
other embodiments may have other numbers of I/O nodes and these I/O nodes may be 
connected in other topologies. The chain topology illustrated in Figure 1 is shown for its 
ease of understanding. Furthermore, it should also be noted that separate processors may 
be connected to each end of the chain of I/O nodes (e.g. in one embodiment, a separate 
processor may be coupled to I/O node 40). 

In the illustrated embodiment, the host bridge of processor 10A may receive 
upstream packet transactions from downstream nodes such as I/O node 20, 30 or 40. 
Alternatively, the host bridge of processor 10A may transmit packets downstream to 
devices such as peripheral devices (not shown) that may be connected to peripheral bus 
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25A for example. It should be noted that the terms "upstream" and "downstream" are 
relative to a given processor. As discussed above, some embodiments may include 
separate processors at each end of a chain of I/O nodes. Thus, packet traffic flow that is 
upstream relative to a processor at one end of the chain may be considered downstream 
relative to a processor at the other end of the chain. For example, if a processor is 
coupled to I/O node 40, packet traffic flow downstream relative to processor 10A 
(coupled to I/O node 20) is upstream relative to the other processor. Similarly, packet 
traffic flow that is upstream relative to processor 10A is downstream relative to the other 
processor. 

Generally speaking, a packet is a communication between two nodes (an initiating 
node which transmits the packet and a destination node which receives the packet). The 
initiating node and the destination node may differ from the source and target node of the 
transaction of which the packet is a part, or either node may be either the source node or 
the target node. A control packet is a packet carrying control information regarding the 
transaction. Certain control packets specify that a data packet follows. The data packet 
carries data corresponding to the transaction and corresponding to the specifying control 
packet. In one embodiment, control packets may include command packets, info packets 
and response packets. It is noted that other embodiments are contemplated which include 
other types of packets. 

As packets travel upstream or downstream on the non-coherent links or between 
coherent nodes on the coherent links, the packets may pass through one or more nodes. 
As used herein, "upstream" refers to packet traffic flow in the direction of the host bridge 
of processor 10A from an I/O node and "downstream" refers to packet traffic flow in the 
direction away from the host bridge of processor 1 OA to an I/O node. As will be 
described in greater detail below, to preserve the ordering rules of the various buses that 
may be connected to a given I/O node, the node may provide transaction reordering as 
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well as packet buffering. Likewise, other nodes may include buffers for preventing 
commands from blocking each other due to logical conflicts between packets of a given 
type. 

Generally speaking, a "virtual channel" is a communication path for carrying 
packets between various processors and I/O nodes. Each virtual channel is resource- 
independent of the other virtual channels (i.e. packets flowing in one virtual channel are 
generally not affected, in terms of physical transmission, by the presence or absence of 
packets in another virtual channel). Packets are assigned to a virtual channel based upon 
packet type. Packets in the same virtual channel may physically conflict with each other's 
transmission (i.e. packets in the same virtual channel may experience resource conflicts), 
but may not physically conflict with the transmission of packets in a different virtual 
channel. 

Certain packets may logically conflict with other packets (i.e. for protocol reasons, 
coherency reasons, or other such reasons, one packet may logically conflict with another 
packet). If a first packet, for logical/protocol reasons, must arrive at its destination node 
before a second packet arrives at its destination node, it is possible that a computer 
system could deadlock if the second packet physically blocks the first packet's 
transmission (by occupying conflicting resources). By assigning the first and second 
packets to separate virtual channels, and by implementing the transmission medium 
within the computer system such that packets in separate virtual channels cannot block 
each other's transmission, deadlock-free operation may be achieved. It is noted that the 
packets from different virtual channels are transmitted over the same physical links. 
Thus, a separate receiving buffer for each virtual channel may be available prior to 
transmission. Thus, the virtual channels do not block each other even while using this 
shared resource. 
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In one embodiment, control packets include commands such as posted and non- 
posted writes, and non-posted reads. In addition, control packets include responses. 
Thus, to support operation as described above, the non-coherent packet interface may 
support three virtual channels corresponding to the three types of commands: non-posted, 
posted and response. It is noted however, that in other embodiments, other virtual 
channels are contemplated and may be used and supported. 

During operation, I/O node 20 and 40 may translate PCI bus transactions into 
upstream packet transactions that travel in I/O streams and additionally may translate 
downstream packet transactions into PCI bus transactions. All packets originating at 
nodes other than the host bridge of processor 10A may flow upstream to the host bridge 
of processor 10A before being forwarded to any other node. All packets originating at the 
host bridge of processor 10A may flow downstream to other nodes such as I/O node 20, 
30 or 40. Each I/O stream may be identified by an identifier called a Unit ID. It is 
contemplated that the Unit ID may be part of a packet header or it may be some other 
designated number of bits in a packet or packets. As used herein, "I/O stream" refers to 
all packet transactions that contain the same Unit ID and therefore originate from the 
same node. 

To illustrate, a peripheral device on peripheral bus 45 initiates a transaction 
directed to a peripheral device on peripheral bus 25. The transaction may first be 
translated into one or more packets with a unique Unit ID and then transmitted upstream. 
It is noted that each packet may be encoded with specific information which identifies the 
packet. For example the Unit ID may be encoded into the packet header. Additionally, 
the type of transaction may also be encoded into the packet header. Each packet may be 
assigned a Unit ID that identifies the originating node. In the present embodiment, I/O 
node 20 may not forward packets to a peripheral device on peripheral bus 25 from 
downstream; the packets are first transmitted upstream to the host bridge of processor 
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10A. The host bridge of processor 10A may then transmit the packets back downstream 
with a Unit ID of the host bridge of processor 10A where I/O node 20 recognizes and 
claims the packet for the peripheral device on peripheral bus 25. I/O node 20 may then 
translate the packets into peripheral bus transactions and transmit the transactions to the 
peripheral device on peripheral bus 25. Further, transactions originating at the host 
bridge of processor 10A will also contain the Unit ID of the host bridge of processor 10A. 
However, as will be described further below, certain packets that are transmitted 
downstream will contain the Unit ID of the sending device. 

As the packet transactions travel upstream or downstream, the packets may pass 
through one or more I/O nodes. The pass-through is sometimes referred to as a tunnel 
and the I/O node is sometimes referred to as a tunnel device. Packets that are sent from 
upstream to downstream or from downstream to upstream are referred to as "forwarded" 
traffic. Additionally, packet traffic that originates at a particular I/O node and is inserted 
into the upstream traffic is referred to as "injected" traffic. 

To preserve the ordering rules of the various buses that may be connected to an 
I/O node, the I/O node may provide transaction reordering as well as packet buffering. 
The I/O node may also include control logic which controls the flow of packets into and 
out of the tunnel by both forwarded and injected traffic. 

Referring to Figure 2, a block diagram of one embodiment of an input/output 
(I/O) node is shown. This particular description will refer to I/O node 20 for simplicity, 
but it should be noted that the description may apply as well to any of the I/O nodes 
shown in Figure 1. Input/output node 20 includes an upstream packet bus interface and a 
downstream packet bus interface, implemented in this embodiment as transceiver circuit 
110 and transceiver circuit 120, respectively. Transceiver circuits 110 and 120 are 
coupled together through an I/O tunnel 140. Transceiver circuits 110 and 120 may each 
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include a transmitter and a receiver (not shown). The transmitters and receivers may be 
connected through I/O tunnel 140 such that the receiver of transceiver 110 may be 
coupled to the transmitter of transceiver 120 and the receiver of transceiver 120 may be 
coupled to the transmitter of transceiver 1 10. I/O tunnel 140 may include command and 
data buses used to forward packet traffic through I/O node 20. In addition, I/O node 20 
includes a peripheral bus interface, implemented here as peripheral interface circuit 150. 
Peripheral interface circuit 150 is coupled to transceivers 1 10 and 120 through I/O tunnel 
140. However as described above, transactions which originate at peripheral interface 
circuit 150 and then enter I/O tunnel 140 may be referred to as injected transactions. I/O 
node 20 also includes a tunnel control unit 130 which is coupled to control the 
transactions between transceivers 110 and 120 and peripheral interface 150. I/O node 20 
is also coupled to a peripheral bus 25 through the peripheral interface circuit 150. 

In the illustrated embodiment, transceivers 110 and 120 are part of two uni- 
directional communication paths through I/O tunnel 140. Since each of the 
communication paths is uni-directional, either path may be connected as the upstream or 
downstream path. Thus, the injected traffic from peripheral interface circuit 150 may be 
provided to either of transceivers 110 and 120. Transceivers 110 and 120 may each 
receive packet transactions into a receive buffer (not shown). As each transaction is 
received, a control command may be generated containing a subset of the information 
contained in the received command. The control command may include the Unit Id of the 
originating node, destination information, a data count and transaction type, for example. 
It is noted that the control command may include other information or may not include 
some of the information listed here. The control command may be sent from transceivers 
110 and 120 to tunnel control unit 130. Tunnel control unit 130 may further determine 
which of the received transactions may be sent from a respective transceiver and to 
indicate to the transceiver to send the transaction to the transaction's destination. 
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In the illustrated embodiment, peripheral interface circuit 150 may be thought of 
as having a downstream section and an upstream section. The downstream section may 
handle downstream transactions whose destination may be a device connected to 
peripheral bus 25. Packets received by the downstream section may allow peripheral bus 
interface circuit to generate cycles on the peripheral bus, enabling communication with 
peripheral devices coupled to the bus. The upstream section may handle transactions 
which originate from devices that may be connected to peripheral bus 25. Thus, 
peripheral interface circuit 150 includes a downstream command buffer 160 and a 
downstream data buffer 170, each coupled to I/O tunnel 140 via tunnel interface logic 
155. Downstream command buffer 160 and downstream data buffer 170 are each 
coupled to peripheral bus 25 via bus interface circuit 210. Peripheral interface circuit 150 
also includes an upstream command buffer 160 and an upstream data buffer 190, each 
coupled to I/O tunnel 140 via tunnel interface logic 155. Upstream command buffer 160 
and upstream data buffer 170 are also each coupled to peripheral bus 25 via bus interface 
circuit 210. Peripheral interface circuit 150 further includes a control logic unit 200 
which is coupled to both upstream command buffer 180 and downstream command 
buffer 160. 

It is noted that in the illustrated embodiment, peripheral bus 25 is illustrative of a 
variety of common peripheral buses such as a PCI bus, a PCI-X bus and an AGP bus for 
example. Additionally, bus interface circuit 210 may include circuitry for translating 
peripheral bus commands from such buses. Further, it is contemplated that in one 
particular embodiment, bus interface circuit 210 may be a bus interface such as a 
Compaq™ Rapid Enabler for PCI-X (CREX) interface. Lastly, it is contemplated that in 
certain embodiments, I/O node 20 may include more than one peripheral interface circuit 
(not shown) and that I/O node may include arbitration logic (not shown) which may 
arbitrate between commands sent from each of the peripheral interface circuits 
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Transactions may be sent from transceiver circuit 110 or 120 depending on which 
transceiver is connected as the downstream receiver. The command portion of the 
transaction may be stored in downstream command buffer 160 and the data portion of the 
transaction may be stored in downstream data buffer 170. Likewise, when a transaction is 
sent from bus interface circuit 210, the command portion of the transaction may be stored 
in upstream command buffer 180 and the data portion of the transaction may be stored in 
upstream data buffer 190. Control logic unit 200 may be configured to control the 
conveyance of the transactions to and from bus interface 210 and VO tunnel 140. 

In response to peripheral interface circuit 150 receiving upstream transactions 
from peripheral bus 25, control logic unit 200 may generate control commands similar to 
the control commands generated by transceivers 110 and 120. Control logic unit 200 may 
also send those control commands to tunnel control unit 130, thus allowing upstream 
commands to be scheduled into I/O tunnel 140. In addition, control logic unit 200 may 
provide downstream circuitry with signals corresponding to upstream commands which 
may allow the downstream circuitry to maintain the relative order of downstream 
response transactions. 

Moving now to Figure 3, a block diagram of one embodiment of a computer 
system configured to allow the observation of packet bus transactions with a logic 
analyzer is shown. Computer system 5 is similar to the computer system of Figure 1, and 
includes host processor 10 and VO nodes 20, 30, and 40, which are serially coupled to 
processor 10. VO nodes 20, 30, and 40 may be similar to VO node 20 of Figure 2. 
Computer system 5 also includes a peripheral bus 25 coupled to I/O node 20. Although 
not shown here, peripheral buses may also be coupled to VO nodes 30 and 40. In 
addition, multiple peripheral buses may be coupled to any of the VO nodes, which may 
have multiple peripheral bus interface units. Peripheral bus 25 may include a connector 
305 which may allow various types of add-on cards and/or peripheral devices to be 
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coupled to computer system 5. In some embodiments, additional connectors may be 
present on the peripheral bus. 



Dummy card 310 may be configured for insertion into connector 305. Dummy 
5 card 310 may allow logic analyzer 315 to be coupled to peripheral bus 25, and thus, I/O 
node 20. Dummy card 310, in the embodiment shown, may be configured to allow the 
passing of electrical signals present on peripheral bus 25 to logic analyzer 315. In various 
embodiments, it may be unnecessary for dummy card 310 to include any functional 
circuitry. Thus, electrical signals appearing on peripheral bus 25 may be allowed to pass 
10 to logic analyzer 3 10 in an unaltered form. 



Any or all of I/O nodes 20, 30, or 40 may be configured to operate in a first 

D (normal) mode of operation and a second (analysis) mode of operation. For the purposes 

□ 

yi of this discussion, reference will be made to I/O node 20, although the discussion may be 

15 applicable to any of the I/O nodes shown, or additional I/O nodes (not shown) that may be 

*J3 added to computer system 5. During the normal mode of operation, data transactions may 

? take place within I/O node 20. Transactions in the normal mode may include the transfer 

2 of packets from the first packet bus link (packet bus 50A) to the second packet bus link 
(packet bus 50B), through I/O tunnel 140 (as illustrated in Figure 2). Normal mode 



p 20 transactions may also include transactions originating or terminating at a device coupled 

m 

to peripheral bus 25. Transactions in the normal mode that involve peripheral bus 25 may 
require conversions between a protocol used by the peripheral bus and a protocol used by 
the packet bus. For example, if peripheral bus 25 is a PCI bus, a transaction in the normal 
mode that sends information from host processor 10 to the device on the PCI bus may 
25 include converting data and/or commands sent according to the packet bus protocol into a 
PCI bus protocol. Similarly, transactions originating from a device coupled to peripheral 
bus 25, using the example of a PCI bus, may require data and/or commands to be 
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converted from the PCI bus protocol to the packet bus protocol. As previously noted, 
other peripheral bus types (and therefore protocols) are possible and contemplated. 

A second mode of operation of I/O node 20 is the analysis mode. Operations in 
the analysis mode include packets conveyed through the I/O tunnel of I/O node 20 (see 
Figure 2) between packet bus link 50 A and packet bus link SOB. The packets may be 
conveyed in either direction, upstream or downstream. The electrical signals of the 
packets passing through I/O node 20 may be replicated and passed onto one or more 
signal lines of peripheral bus 25. The packets replicated on the peripheral bus need not be 
converted to the peripheral bus protocol. During the normal mode of operation, 
peripheral bus interface 150 of I/O node 20 may perform the required protocol 
conversions. However, in the analysis mode of operation, protocol conversions need not 
be performed. Instead, electrical signals present on the packet bus are allowed to pass "as 
is" through peripheral bus interface 150 onto the peripheral bus. These signals may then 
pass through connector 305 and dummy card 310 to logic analyzer 315. Thus, electrical 
signals on the packet bus, normally inaccessible to test equipment, may be observed by 
test equipment such as logic analyzer 315. In addition to a logic analyzer, other types of 
signal analyzers may be used also for various testing purposes (e.g. to ascertain an 
amount of noise present on the packet bus during packet bus transactions). 

When I/O node 20 is in analysis mode, it may be virtually invisible to system 
software and other system hardware. Packets may merely pass through I/O node 20 in 
analysis mode, while the electrical signals of the packets may be replicated on peripheral 
bus 25. In addition to replicating the electrical signals on peripheral bus 25, an indication 
of whether a given packet is being conveyed upstream or downstream may also be 
provided to peripheral bus 25. In one embodiment, a single bit may be used to indicate 
whether the transaction is upstream or downstream. The bit may be in a set state to 
indicate an upstream transaction, and a reset state to indicate a downstream transaction. 
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Other embodiments using different forms of an upstream/downstream indication are 
possible and contemplated. 

Using a logic analyzer or signal analyzer in the configuration shown in Figure 3, it 
5 may be possible to conduct testing and/or to debug problems occurring on the packet bus 
on any I/O node coupled to the packet bus, and any peripheral buses/devices coupled to 
the I/O nodes. For example, using the particular configuration shown in Figure 3, I/O 
node 20, when in analysis mode, may allow for the monitoring of packet bus transactions 
between host processor 10 and VO node 30. Host processor 10 may transmit packets 
10 downstream to VO node 30. As the packets pass through VO node 20 (which is in 
analysis mode for this example), the electrical signals of the packet may be replicated 
onto peripheral bus 25, and thereby monitored by logic analyzer 315. VO node 30 may 

Q transmit information upstream back to host processor 10 responsive to receiving the 

D 

yi original transmission. Again, logic analyzer 315 may be used to monitor the packets as 

15 they pass through VO node 20 and corresponding electrical signals are replicated onto 
peripheral bus 25. If a peripheral device coupled to I/O node 30 is functioning 
erroneously, monitoring of both the upstream and downstream transactions may yield 
p information pertaining to the problem, and may in some cases even allow a fault to be 

TU isolated. Many other uses are possible and contemplated, and the analysis mode for each 

p 20 VO node may aid debugging for both operational and developmental environments. . 

ry 

VO node 20 includes command register 302. Command register 302 may be 
configured to store a plurality of bits, including one or more bits indicating the particular 
mode that VO node 20 is operating in. In one embodiment, VO node 20 may be placed in 
25 the analysis mode by latching signals corresponding to the one or more bits into 
command register 302 during a power-on reset. During the power-on reset, command 
register 302 may capture and hold the state of the signals that are latched into it, thereby 
placing it into the analysis mode. The signals may be conveyed one or more lines of the 



Any. Dkt. No.: 5500-73200 



Page 19 



Conley, Rose & Tayon, PC 



peripheral bus in some embodiments, or may be conveyed through the packet bus in other 
embodiments. The analysis mode may be exited by performing a second power-on reset 
without latching the necessary signal states to command register 302. Other methods of 
entering and exiting the analysis mode are possible and contemplated, and may include 
5 use of either the packet bus or the peripheral bus, and may further involve host processor 
10. 



Moving now to Figure 4, a block diagram of another embodiment of a computer 
system configured to allow the observation of electrical signals corresponding to packets 
10 conveyed on the packet bus. In the embodiment shown, logic analyzer 315 is directly 
coupled to connector 305, with no dummy card (such as dummy card 310 of Figure 3) 
present. In this embodiment, computer-based instrumentation may be employed, as logic 

Q analyzer 315 may be a logic analyzer card. Such a logic analyzer card (or signal analyzer 

□ 

lp card) may be coupled to a monitor or another computer system in order to display the 

£ 15 logic states of the transactions occurring on the packet bus. This may eliminate the need 

m 

yp for a dummy card and/or a traditional logic/signal analyzer. 

|+ 

e 

P Figures 5A and 5B illustrate the difference between normal mode and analysis 

ftj mode for one embodiment of an VO node. Turning now to Figure 5A, a block diagram of 

20 a computer system is shown in order to illustrate packet bus transactions in a normal 
mode of operation. In the embodiment shown, packets conveyed from host processor 10 
to I/O node 30 may pass through VO tunnel 140 of I/O node 20. Similarly, packets 
conveyed from I/O node 30 also pass through I/O tunnel 140 of I/O node 20. Packet 
transmissions from host processor 10 to peripheral device 350 enter I/O tunnel 140 and 
25 are then conveyed to peripheral bus interface 150. A protocol conversion from the packet 
bus protocol to the peripheral bus protocol may be performed by peripheral bus interface 
150. Following conversion to the peripheral bus protocol, peripheral bus interface 150 
may generate peripheral bus cycles in order to convey any data and/or commands present 



in 



ru 
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in the original packet to peripheral device 350. Similarly, a transmission from peripheral 
device 350 to host processor 10 begins with a transmission by the peripheral device onto 
peripheral bus 25. Peripheral bus interface 150 may receive the transmission, and 
perform a conversion from the peripheral bus protocol to the packet bus protocol. A 
packet transmission to host processor 10 may then be completed, as the packet(s) may be 
conveyed to I/O tunnel 140 and on to host processor 10 via packet bus link 50A. 

The analysis mode is illustrated in Figure 5B. In the embodiment shown, packets 
conveyed from host processor 10 to I/O node 30, or vice versa are also allowed to pass 
through tunnel 140 of I/O node 20. Additionally, the electrical signals of the packets may 
be replicated and conveyed onto peripheral bus 25. In some embodiments, the 
transmissions may completely bypass peripheral bus interface 150 (not shown in Figure 
5B), while in other embodiments, peripheral bus interface 150 may allow the electrical 
signals to pass through unaltered. In either case, no conversion to the protocol of 
peripheral bus 25 is required. Thus, by allowing the electrical signals of packet bus 
transactions to pass to peripheral bus 25 without any protocol conversion, upstream and 
downstream packet bus transactions may be observed by a logic and/or signal analyzer as 
shown in Figures 3 and/or 4. 

I/O node 20 may be configured to provide an indication of whether a particular 
packet is conveyed upstream or downstream. Thus, when using a signal or logic analyzer 
to observe electrical signals corresponding to the particular packet, it may be determined 
whether the particular packet is being conveyed upstream or downstream. In one 
embodiment, the indication may be in the form of electrical signals conveyed on one or 
more lines of peripheral bus 25. In embodiments wherein separate processors are coupled 
to each end of a chain of I/O nodes, the indication may also designate to which processor 
the direction of packet flow is relative to. The ability to determine the direction in which 
particular packets are being conveyed may aid in debugging problems pertaining to 
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devices for which the packet bus is used as a communications path (e.g. a peripheral 
device coupled to an I/O node, wherein the peripheral device may communicate with the 
host processor). 

In some embodiments, the bandwidth of the packet bus may exceed the bandwidth 
of the peripheral bus. In such embodiments, I/O node 20 may include an arbitration unit, 
such as arbiter 303 shown here. When two or more packets pass through the tunnel 
simultaneously during analysis mode, there may be a conflict as to which packet will have 
its electrical signals replicated on the peripheral bus. In cases where conflicting packets 
are present, arbiter 303 may be configured to determine which packet has priority. By 
determining the priority of the packets, arbiter 303 may determine the order in which 
electrical signals from each of the packets is to appear on the peripheral bus. Thus, the 
presence of arbiter 303 may ensure that electrical signals for all packets are eventually 
replicated on the bus, regardless of the bandwidth of the peripheral bus relative to the 
bandwidth of the packet bus. It should also be noted that arbiter 303 may, in the normal 
mode, determine the ordering for which peripheral bus cycles corresponding to particular 
packets are generated, wherein the particular packets are received by the peripheral bus 
interface. 

While the present invention has been described with reference to particular 
embodiments, it will be understood that the embodiments are illustrative and that the 
invention scope is not so limited. Any variations, modifications, additions, and 
improvements to the embodiments described are possible. These variations, 
modifications, additions, and improvements may fall within the scope of the inventions as 
detailed within the following claims. 
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